Control apparatus, method of controlling the same, and storage medium

ABSTRACT

A control apparatus comprises a determination unit configured to determine a region defined by a pair of first coordinate values and a pair of second coordinate values which are designated on a captured image displayed on a display unit; a display control unit configured to control the display unit to display, when the region exceeds a display range of the captured image in accordance with an operation of designating at least one of the pair of first coordinate values and the pair of second coordinate values, a predetermined image including at least a part of the region on a portion that has exceeded the range while holding the region; and an output unit configured to output a command for obtaining a captured image corresponding to the region displayed and controlled by the display control unit.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.15/091,943, filed on Apr. 6, 2016, which claims the benefit of andpriority to Japanese Patent Application No. 2015-082065, filed on Apr.13, 2015, the disclosures of each of which are hereby incorporated byreference herein in their entirety.

BACKGROUND OF THE INVENTION

Field of the Invention

The present invention relates to a technique for obtaining a capturedimage from an image capturing apparatus and controlling the display ofthe captured image on a display unit.

Description of the Related Art

As a conventional technique for changing an angle of view of an imagecapturing apparatus such as a monitoring camera, there is proposed atechnique in which an image capturing direction of the image capturingapparatus and a focal length of a telephoto/wide-angle optical systemare changed, by user operation via an information processing apparatus,to change the angle of view. A technique for instructing an image zoomoperation via an image displayed on the monitor that is incorporated ina digital camera or a portable terminal has also been proposed.

Japanese Patent Laid-Open No. 2004-157869 discloses a portable terminalcapable of performing a zoom operation on an arbitrarily designateddisplay screen region by displaying a zoom region, which has beeninstructed via the portable terminal, on a screen and enlarging anddisplaying the zoom region on the entire screen.

However, in the case of the conventional art, the range that can beenlarged is limited by the range of the image displayed by the portableterminal. Therefore, the range of enlargement cannot be designated to begreater than the range of the captured image.

The present invention has been made to solve the above problems, andprovides a technique capable of easily and appropriately adjusting animage capturing range of a captured image.

SUMMARY OF THE INVENTION

According to one aspect of the present invention, there is provided acontrol apparatus that obtains a captured image from an image capturingapparatus and controls display of the captured image on a display unit,comprising: a determination unit configured to determine a regiondefined by a pair of first coordinate values and a pair of secondcoordinate values which are designated on the captured image displayedon the display unit; a display control unit configured to control thedisplay unit to display, when the region exceeds a display range of thecaptured image in accordance with an operation of designating at leastone of the pair of first coordinate values and the pair of secondcoordinate values, a predetermined image including at least a part ofthe region on a portion that has exceeded the range while holding theregion; and an output unit configured to output a command for obtaininga captured image corresponding to the region displayed and controlled bythe display control unit.

Further features of the present invention will become apparent from thefollowing description of exemplary embodiments with reference to theattached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1A and 1B are views showing the arrangement of an image capturingsystem;

FIG. 2 is a block diagram showing the hardware arrangement of an imagecapturing apparatus and a client;

FIG. 3 is a sequence chart showing a command sequence;

FIGS. 4A and 4B are views showing the structure of a SetBoxZoomcommand/response;

FIG. 5 is a view showing an example of a coordinate system;

FIG. 6 is a view for explaining display control of a captured image; and

FIGS. 7A and 7B are flowcharts showing the operations of the client andthe image capturing apparatus.

DESCRIPTION OF THE EMBODIMENTS

An exemplary embodiment(s) of the present invention will now bedescribed in detail with reference to the drawings. It should be notedthat the relative arrangement of the components, the numericalexpressions and numerical values set forth in these embodiments do notlimit the scope of the present invention unless it is specificallystated otherwise.

FIG. 1A is a view showing an example of the arrangement of an imagecapturing system. In the image capturing system according to theembodiment, an image capturing apparatus 100 and a client 200 as anexternal apparatus are connected to each other via a network 300. Thisallows the image capturing apparatus 100 to communicate with the client200 via the network 300. The image capturing apparatus 100 distributes acaptured image to the client 200 via the network 300. The client 200 isan example of an external apparatus and can be, for example, constitutedby an information processing apparatus. In addition, the client 200 isalso a control apparatus capable of setting image capturing conditionson the image capturing apparatus 100 and controlling its operation.

Note that the image capturing apparatus 100 is, for example, amonitoring camera that captures a moving image or a still image. Morespecifically, assume that the image capturing apparatus 100 is an imagecapturing apparatus for monitoring, and communication between the imagecapturing apparatus 100 and the client 200 is performed by using, forexample, a communication protocol defined by ONVIF. Also, assume thatthe image capturing apparatus 100 is installed in, for example, apredetermined position within a space such as a wall or ceiling.

The network 300 is formed by, for example, communication devices andcommunication lines such as a plurality of routers, switches, and cablesthat operate according to a communication specification such asEthernet®. In the embodiment, any communication specification, scale orarrangement is applicable as long as communication between the imagecapturing apparatus 100 and the client 200 is possible. For example, thenetwork 300 can be can be constituted by a communication line such asthe internet, a wired LAN (Local Area Network), a wireless LAN, or a WAN(Wide Area Network). Note that the image capturing apparatus 100 cancomply with PoE (Power over Ethernet®) and be supplied with power via aLAN cable.

The client 200 receives a captured image distributed from the imagecapturing apparatus 100 via the network 300 and displays the receivedimage on a display unit 210. The client 200 also transmits to the imagecapturing apparatus 100, via the network 300, a command in accordancewith a user operation. For example, the client 200 transmits, in aformat defined by ONVIF, a command (request) for changing the imagecapturing conditions (for example, the image capturing direction, angleof view, and the like) of the image capturing apparatus 100.

The image capturing apparatus 100 changes the image capturing direction(pan, tilt) in accordance with a command, received from the client 200,for changing the image capturing direction. In addition, the imagecapturing apparatus 100 changes the angle of view in accordance with acommand, received from the client 200, for changing the angle of view(zoom [telephoto control/wide-angle control]).

FIG. 1B is a view showing an example of a driving mechanism for theimage capturing apparatus 100 to change the image capturing direction orthe angle of view. A pan driving mechanism 111 changes the imagecapturing direction of the image capturing apparatus 100 in the pandirection. A tilt driving mechanism 112 changes the image capturingdirection of the image capturing apparatus 100 in the tilt direction. Azoom mechanism 113 changes the angle of view of the image capturingapparatus 100. In this manner, the pan driving mechanism 111, the tiltdriving mechanism 112, and the zoom mechanism 113 constitute a PTZdriving mechanism that changes the respective pan, tilt, and zoom of theimage capturing apparatus 100. Note that in this embodiment, driving ofeach pan driving mechanism 111, the tilt driving mechanism 112, and thezoom mechanism 113 is implemented by, for example, a driving system suchas a stepping motor and a gear.

FIG. 2 is a block diagram showing an example of the hardware arrangementof the image capturing apparatus 100 and the client 200.

The image capturing apparatus 100 includes a front lens 122 and avariator lens 124 of the image capturing optical system, an image sensor126, an image processing circuit 128, an encoding circuit 130, a buffer132, a communication circuit 134 (to be referred to as a communicationI/F hereinafter), and a communication terminal 136. The image capturingapparatus 100 also includes a pan driving circuit 142, a tilt drivingcircuit 143, a variator lens driving circuit 144 (to be referred to as azoom driving circuit hereinafter), a central processing unit 146 (to bereferred to as a CPU hereinafter), and a non-volatile memory 148.

The client 200 includes a communication terminal 236, a communicationcircuit 234 (to be referred to as a communication I/F hereinafter), acentral processing unit 246 (to be referred to as a CPU hereinafter), anon-volatile memory 248, a display unit 210, an input unit 212, astorage unit 213, and a command creation unit 250. The storage unit 213stores, as various kinds of data and parts of variables to be used inthe client 200, a Box zoom region 216 serving as a predetermined regionand a black belt region 214 serving as a predetermined image.

Note that the non-volatile memories 148 and 248 are, for example,EEPROMs (Electrically Erasable Programmable Read Only Memories). Thenon-volatile memory 148 stores various kinds of programs such as acontrol program for controlling the operation of the image capturingapparatus 100. The CPU 146 can control the various kinds of operationsof the image capturing apparatus 100 by reading out and executing theprograms stored in the non-volatile memory 148. The non-volatile memory248 stores various kinds of programs such as a control program forcontrolling the operation of the client 200. The CPU 246 can control thevarious kinds of operations of the client 200 by reading out andexecuting the programs stored in the non-volatile memory 248.

Next, the operations of the image capturing apparatus 100 and the client200 will be described with reference to FIG. 2.

A light beam from an object to be captured by the image capturingapparatus 100 enters the image sensor 126 via the front lens 122 and thevariator lens 124 of the image capturing optical system and isphotoelectrically converted by the image sensor 126. The zoom drivingcircuit 144 moves the variator lens 124 in the optical-axis directionbased on a driving signal from the CPU 146. The focal length of theimage capturing optical system changes along with this movement of thevariator lens 124. The angle of view of the image to be captured by theimage capturing apparatus 100 changes from this change in the focallength.

A pan driving motor (not shown) is driven based on a driving signalinput from the CPU 146 to the pan driving circuit 142. The pan drivingmechanism 111 in FIG. 1B is driven by this driving operation, and theimage capturing direction in the pan direction of the image capturingapparatus 100 changes. In the same manner, a tilt driving motor (notshown) is driven based on a driving signal input from the CPU 146 to thetilt driving circuit 143. The tilt driving mechanism 112 in FIG. 1B isdriven by this driving operation, and the image capturing direction inthe tilt direction of the image capturing apparatus 100 changes.

In the embodiment, when a normal image capturing operation is to beperformed, an image signal consisting of a luminance signal and a colordifference signal is output as a captured image signal from the imageprocessing circuit 128 to the encoding circuit 130 based on aninstruction from the CPU 146. The encoding circuit 130 encodes the inputimage signal, and the encoded image signal is output to the outside viathe buffer 132, the communication I/F 134, and the communicationterminal 136.

The client 200 obtains, via the communication terminal 236 and thecommunication circuit 234, the captured image distributed from the imagecapturing apparatus 100 via the network 300. The client 200 outputs theobtained captured image to the display unit 210 and displays the image.The input unit 212 is an input device that accepts user input and isformed from, for example, a pointing device or a touch panel. The usercan perform a mouse operation or a touch operation by the input unit212. Additionally, by performing a predetermined operation by using theinput unit 212, the user can cause the Box zoom region 216 for enlarging(zooming) a displayed captured image to be displayed on the display unit210. As an example of this predetermined operation, there is anoperation in which a dragging operation (pressing down an input unit(for example, a mouse button) and moving the cursor to the intendedposition) is performed and the cursor is released. Furthermore, the usercan use the input unit 212 to perform a moving operation of changing thedisplay position of the displayed Box zoom region 216 on the displayunit 210 while maintaining the size of the Box zoom region 216.

If the Box zoom region 216 exceeds the range of the displayed capturedimage in accordance with the user operation, the client 200 displays theblack belt region 214 and continues to display the Box zoom region 216.Additionally, the client 200 can create, by the command creation unit250, a command that gives an instruction to change the pan, tilt, andzoom of the image capturing apparatus 100 in order to obtain an image ofan angle of view that includes the Box zoom region 216. The createdcommand is transmitted to the image capturing apparatus 100, via thecommunication circuit 234 and the communication terminal 236, to changethe image capturing direction. If a captured image is transmitted fromthe image capturing apparatus 100, the client 200 displays the capturedimage again on the black belt region 214. A past captured image of thecorresponding region can be used as the black belt region 214.Alternatively, an image including another message (for example,information indicating that Box zoom region exceeds the image capturingrange of the current image capturing apparatus 100) can be used.

Next, a typical BoxZoom command sequence, between the client 200 and theimage capturing apparatus 100, for changing the settings of the zoommagnification and the image capturing direction of the image capturingapparatus 100 will be described with reference to FIG. 3. Note that eachtransaction to be described below indicates a pair of a requesttransmitted from the client 200 to the image capturing apparatus 100 anda response to the request returned from the image capturing apparatus100 to the client 200 by using a predetermined command.

A transaction 1201 is the transaction of a GetServiceCapabilitiescommand. By issuing a GetServiceCapabilities request to the imagecapturing apparatus, the client 200 can give instructions to returnfunctional information indicating the functions (capabilities) supportedby the image capturing apparatus 100. This functional informationincludes information of a SetBoxZoom command which indicates a zoomoperation instruction for the region designated in the captured image.

When the user confirms the settings of first coordinates (for example,P1 coordinates) and second coordinates (for example, P2 coordinates)concerning the captured image to be displayed on the display unit 210,the client 200 issues a SetBoxZoom command including the firstcoordinates and the second coordinates. In this case, a rectangledefined by the diagonal line connecting the first coordinates and thesecond coordinates is set as the Box zoom region.

Based on this SetBoxZoom command, the image capturing apparatus 100calculates, from the obtained first coordinates and the secondcoordinates, a change value of the image capturing angle and the zoommagnification indicating the angle of view of the image capturingapparatus 100 and drives the image capturing apparatus 100 based on thecalculated change value. In the following description, BoxZoom,SetBoxZoom, and SetBoxZoomConfiguration may be abbreviated as “BZ”,“SetBZ”, and “SetBZC”, respectively.

A transaction 1202 is the transaction of a GetConfigurations command.The client 200 can obtain PTZ setting information of the image capturingapparatus 100 from the image capturing apparatus 100 by issuing aGetConfigurations request to the image capturing apparatus 100. Inresponse to this GetConfigurations command, the image capturingapparatus 100 returns, to the client 200, a GetConfigurations responseincluding a list of all the PTZ settings set in the image capturingapparatus. Together with the plurality of PTZ settings, respectivepieces of Token information which are identification information foridentifying the PTZ settings are included in the PTZ settings list. ThisToken information will be referred to as ConfigurationToken in theembodiment.

A transaction 1203 is the transaction of a GetConfigurationOptionscommand. The client 200 can issue a GetConfigurationOptions request tothe image capturing apparatus 100 by including a ConfigurationToken inthe request. Upon receiving the request, the image capturing apparatus100 returns a GetConfigurationOptions response including the optioninformation usable in the settings designated by the ConfigurationTokento the client 200. For example, in the embodiment, theGetConfigurationOptions response includes the list information ofProfileToken settable in a SetBoxZoom command. The client 200 can issuea SetBoxZoom command by selecting a desired ProfileToken from aProfileToken list.

A transaction 1204 is the transaction of a SetBoxZoom command. Theclient 200 transmits a SetBoxZoom command including the SetBoxZoomrequest information, the ProfileToken information, the firstcoordinates, and the second coordinates to the image capturing apparatus100. Upon receiving the command, the image capturing apparatus 100stores the ProfileToken, the first coordinates, and the secondcoordinates included in the SetBoxZoom command in, for example, thenon-volatile memory 148. The image capturing apparatus 100 also returnsa SetBoxZoom response to the client 200 in accordance with the contentsincluded in the SetBoxZoom command.

The image capturing apparatus 100 changes the angle of view of the imagecaptured by itself based on the stored first coordinates and the secondcoordinates. That is, the image capturing apparatus 100 performs drivingof the pan, tilt, and zoom mechanisms to obtain an image in thedesignated angle of view.

FIGS. 4A and 4B are views showing the structures of the SetBoxZoomcommand and the SetBoxZoom response.

FIG. 4A is a view showing the structure of the SetBoxZoom command. TheSetBoxZoom command includes a destination address 3001, a transmissionsource address 3003, a data field 3005 indicating the SetBoxZoomrequest, a ProfileToken field 3007, a start point coordinate field 3009,and an end point coordinate field 3015.

The start point coordinate field 3009 and the end point coordinate field3015 each include an X-coordinate field and a Y-coordinate field. Morespecifically, the start point coordinate field 3009 includes anX-coordinate field 3011 and Y-coordinate field 3013 that define thestarting point in the range of the Box zoom region. The end pointcoordinate field 3015 includes an X-coordinate field 3017 andY-coordinate field 3019 that define the starting point in the range ofthe Box zoom region.

The destination address 3001 stores the address of the image capturingapparatus which is the transmission destination of the SetBoxZoomcommand. The transmission source 3003 stores the address of the client200 as the transmission source. Assume that an IP address will be usedas the address, but as long as it is information (such as a MAC address)that will allow the communicating devices to uniquely identify eachother, it is not limited this.

FIG. 4B is a view showing the structure of the SetBoxZoom response. TheSetBoxZoom response includes a destination address 3021, a transmissionaddress 3023, and a SetBoxZoom response field 3025.

The SetBoxZoom response indicates that the corresponding packet is aSetBoxZoom response by the SetBoxZoom response field 3025. Thedestination address 3021 stores the address of the client 200 as thetransmission destination of the SetBoxZoom response. The transmissionsource address 3023 stores the address of the image capturing apparatus100 as the transmission source.

In the embodiment, the image capturing apparatus 100 controls thepan/tilt/zoom operations by receiving the SetBoxZoom command shown inFIG. 4A from the client 200.

More specifically, the image capturing apparatus 100 first compares thevalue of the X-coordinate field 3011 of the start point and the value ofthe X-coordinate field 3017 of the end point included in the SetBoxZoomcommand. That is, the image capturing apparatus 100 compares themagnitude relation between the two values. Then, if it is determined bythe comparison that the value of the Y-coordinate field 3011 is smallerthan the value of the X-coordinate field 3017, an adjustment is made toincrease the focal length of the zoom optical system of the imagecapturing apparatus 100. If the coordinate value of the X-coordinatefield 3011 of the start point is larger than the coordinate value of theX-coordinate field 3017 of the end point, an adjustment is made todecrease the focal length of the zoom optical system of the imagecapturing apparatus 100. Furthermore, if the coordinate value of theX-coordinate field 3011 of the start point is the same value as thecoordinate value of the X-coordinate field 3017 of the end point, thepan and tilt are adjusted so that the point related to the coordinatevalue in the control command will be positioned at the center of thecurrent image.

In this manner, the image capturing apparatus 100 that received theSetBoxZoom command controls the pan/tilt/zoom operations based on theinformation stored in the command. The image capturing apparatus 100performs a zoom-out operation if the value of the X-coordinate field3011 of the start point is smaller than the value of the X-coordinatefield 3017 of the end point. The image capturing apparatus 100 performsa zoom-in operation if the value of the X-coordinate field 3011 of thestart point is larger than the value of the X-coordinate field 3017 ofthe end point. The image capturing apparatus 100 adjusts thepan/tilt/zoom operations so that the zoom operation at this time willset a Box zoom region designated by the start point coordinate field3009 and the end point coordinate field 3015 as the image capturingrange after the zoom-in operation.

Note that although the Box zoom region designated by the start pointcoordinate field 3009 and the end point coordinate field 3015 is set asthe image capturing range after the zoom at the time of the zoom-outoperation in the embodiment, the present invention is not limited tothis. For example, the image capturing range after the zoom at the timeof the zoom-out operation can be determined by another designationmethod. For example, the zoom out can be operated by a method thatdesignates the coordinates of two points in the angle of view before thezoom out to be the start point coordinate field 3009 and the end pointcoordinate field 3015. In such a case, the zoom ratio uses, for examplethe ratio of the X-direction length of the Box zoom region designated bythe start point coordinate field 3009 and the end point coordinate field3015 to the horizontal length (X-direction length) of the imagecapturing region. The zoom ratio can also be designated by using a ratioof the Y-direction length of the Box zoom region designated by the startpoint coordinate field 3009 and the end point coordinate field 3015 tothe vertical length (Y-direction length) of the image capturing region.Furthermore, the zoom ratio can be designated by using the ratio of thediagonal direction length of the Box zoom region designated by the startpoint coordinate field 3009 and the end point coordinate field 3015 andthe diagonal direction length of the image capturing range.

Next, the arrangement of the coordinate system used in the embodimentwill be described with reference to FIG. 5.

In FIG. 5, a region 3501 is an image capturing range in which the imagecapturing apparatus 100 can capture an image and is defined bytwo-dimensional plane (two-dimensional coordinate system) of X- and Y-axes. An image capturing frame 3502 shows the angle of view of the imagecapturing apparatus 100. A region 3503 is a Box zoom region designatedby the start point coordinate field 3009 and the end point coordinatefield 3015 of the SetBoxZoom command. Coordinates 3504 are the startpoint coordinates of the SetBoxZoom command. Coordinates 3505 are theend point coordinates of the SetBoxZoom command. Coordinates 3506 arethe center coordinates of the designated Box zoom region 3503.

In the coordinate system shown in FIG. 5, the image capturing range 3501is defined so that the range of the X-coordinate values and theY-coordinates values will be from −1 to +1. This coordinate system iscalled, for example, a normalized coordinate system. In the embodiment,the range of the X-coordinate values and the Y-coordinate values of theimage capturing frame 3502 in this normalized coordinate system isarranged so that it will not change even if the pan/tilt/zoom operationsof the image capturing apparatus are performed. That is in thenormalized coordinate system of the embodiment, the image capturingrange 3501 is arranged so that the X-coordinate values and theY-coordinate values will be −1 to +1 regardless of the pan/tilt/zoomoperations of the image capturing apparatus 100.

Note that this normalized coordinate can be arranged so thatX-coordinate values and the Y-coordinate values of the current angle ofview will be −1 to +1 and can be rearranged after the image capturingapparatus 100 has operated.

In FIG. 5, assume that the X-coordinate value is X1 and Y-coordinatevalue is Y1 for the start point coordinates 3504 of the SetBoxZoomcommand. In this case, X1 is stored in the X-coordinate field 3011 andY1 is stored in the Y-coordinate field 3013 of the start point in FIGS.4A and 4B. Also, in FIG. 5, assume that the X-coordinate value is X2 andY-coordinate value is Y2 for the end point coordinates 3505 of theSetBoxZoom command. In this case, X2 is stored in the X-coordinate field3017 and Y2 is stored in the Y-coordinate field 3019 of the end point inFIGS. 4A and 4B.

In the example shown in FIG. 5, since the start point X-coordinate valueX1 is smaller than the end point X-coordinate value X2, a zoom-inoperation is performed and an adjustment is made to increase the focallength of the image capturing optical system. In contrast to thisexample, if the start point X-coordinate value X1 is larger than the endpoint X-coordinate value X2, a zoom-out operation is performed and anadjustment is made to decrease the focal length of the image capturingoptical system.

In addition, the image capturing apparatus 100 adjusts the pan and tiltoperations with respect to a center point C which is the centercoordinates 3506 of the Box zoom region according to the designatedcoordinates so that the coordinate point of the center point C will beset as the center after the zoom operation.

An example of display control of the captured image to be displayed onthe display unit 210 of the client 200 for implementing this operationwill be described with reference to FIG. 6.

In FIG. 6, a region 4002 is an image frame showing an angle of view. Aregion 4003 is a Box zoom region designated by the start pointcoordinate field 3009 and the end point coordinate field 3015 of theSetBoxZoom command. Coordinates 4004 are the start, point coordinates ofthe SetBoxZoom command. Coordinates 4005 are the end point coordinatesof the SetBoxZoom command. Coordinates 4006 are the center coordinatesof the designated Box zoom region.

601 of FIG. 6 is a view showing the captured image before thepan/tilt/zoom operations according to the embodiment. In 601 of FIG. 6,since an X-coordinate value X1 of the start point coordinates 4004 (P1)in the Box zoom region 4003 designated by the SetBoxZoom command issmaller than an X-coordinate value X2 of the end point coordinates 4005(P2), a zoom-in operation is performed at the end of use operation.

In 602 of FIG. 6, if the Box zoom region 4003 exceeds the imagecapturing range 4002 in accordance with the moving operation of the Boxzoom region 4003, the portion that has exceeded the image capturingrange is displayed on a black belt region 4100 and the Box zoom region4003 is held. At this time, pan/tilt/zoom commands giving instructionsfor an image capturing angle of view which includes at least a part ofthe Box zoom region 4003 may be transmitted to the image capturingapparatus 100.

603 of FIG. 6 is a view showing the captured image after thepan/tilt/zoom operations. The captured image received from the imagecapturing apparatus 100 is displayed in the black belt region 4100.Additionally, in the embodiment, the CPU 146 adjusts the pan/tilt/zoomoperations so that the center point 4006 of the Box zoom region 4003designated at the time when the user operation ended is set as thecenter 4007 of an image capturing angle of view.

Next, the respective operations of the client 200 and the imagecapturing apparatus 100 will be described with reference to theflowcharts of FIGS. 7A and 7B.

Note that the flowchart shown in FIG. 7A is implemented by the CPU 246of the client 200 reading out and executing a program stored in thenon-volatile memory 248. The flowchart shown in FIG. 7B is implementedby the CPU 146 of the image capturing apparatus 100 reading out andexecuting a program stored in the non-volatile memory 148.

In FIG. 7A, the CPU 246 of the client 200 determines, in step S5001,whether the Box zoom region exceeds the range (image capturing range) ofthe captured image based on an operation by the user on the capturedimage to be displayed on the display unit 210. If it is determined thatthe Box zoom region does not exceed the image capturing range (NO instep S5001), the process advances to step S5007. On the other hand, ifit is determined that the Box zoom region exceeds the image capturingrange (YES in step S5001), the CPU 246 determines whether the Box zoomregion can fit within the maximum angle of view of the image capturingapparatus 100 in step S5002.

Note that this determination determines whether the Box zoom regionexceeds the image capturing range by, for example, determining whetherthe end point (second coordinate values) of the Box zoom region hasreached the image capturing range.

If it is determined that the Box zoom region is within the maxim angleof view of the image capturing apparatus 100 (YES in step S5002), theCPU 246 displays, in the black belt region, the portion that exceeds thecurrently displayed range (image capturing range) of the captured imageof the image capturing apparatus 100 and holds the Box zoom region instep S5003. In step S5004, the CPU 246 calculates the pan/tilt/zoomamounts that set the Box zoom region within the captured image andcreates a SetBoxZoom command including the calculated pan/tilt/zoomamounts. In step S5501, the CPU 246 transmits the created SetBoxZoomcommand to the image capturing apparatus 100. The client 200 can controldriving of the pan/tilt/zoom mechanisms of the image capturing apparatus100 by transmitting this SetBoxZoom command to the image capturingapparatus 100.

On the other hand, if it is determined that the Box zoom region is notwithin the maximum angle of view of the image capturing apparatus 100(NO in step S5002), the CPU 246 controls the display of the Box zoomregion so that the coordinate positions of the Box zoom region does notexceed the maximum angle of view in step S5006. In step S5007, the CPU246 determines whether user operation has ended. If it is determinedthat the user operation has not ended (NO in step S5007), the processreturns to step S5001. Otherwise (YES in step S5007), the CPU 246calculates, in step S5008, the pan/tilt/zoom amounts that set the centercoordinates of the Box zoom region at the center of the captured imageand creates a SetBoxZoom command including the calculated pan/tilt/zoomamounts. In step S5502, the CPU 246 transmits the created SetBoxZoomcommand to the image capturing apparatus 100.

Next, the operation (driving of pan/tilt/zoom mechanisms) executed bythe image capturing apparatus 100 in accordance with the SetBoxZoomcommand received from the client 200 will be described with reference toFIG. 7B.

In step S5511, the CPU 146 of the image capturing apparatus 100 receivesthe SetBoxZoom command from the client 200. In step S5512, the CPU 146analyzes the parameters stored in the received SetBoxZoom command. Theparameters to be analyzed in this case are, for example, theProfileToken field 3007, the start point coordinate field 3009, and theend Point coordinate field 3015 shown in FIG. 4A.

In step S5513, the CPU 146 transmits to the client 200 a SetBoxZoomresponse in return for the SetBoxZoom command. In step S5514, theparameter analysis result of the SetBoxZoom command is evaluated todetermine whether the parameters are normal.

If it is determined that the parameters are abnormal (NO in step S5514),the processing is determined to be inexecutable and is ended. A case inwhich the value of the ProfileToken field 3007 is not a value set is theimage capturing apparatus 100 is an example of parameter abnormality. Acase in which at least one of the start point coordinate field 3009 andthe end point coordinate field 3015 is at a value range not supported bythe image capturing apparatus 100 can be enumerated as another exampleof parameter abnormality.

Note that if the parameters are normal, the SetBoxZoom response to betransmitted in step S5513 will be a SUCCESS response. On the other hand,if the parameters are abnormal, the SetBoxZoom response will be a FAILresponse.

On the other hand, if it is determined that the parameters are normal(YES in step S5514), the start point X-coordinate value X1 and the endpoint X-coordinate value X2 are compared in step S5520.

If it is determined that the value of X1 is smaller than the value of X2(X1<X2), the CPU 146 calculates the pan/tilt/zoom-in amount in stepS5521. Then, in step S5522, the CPU 146 performs the pan/tilt/zoom-inoperations in accordance with the calculated pan/tilt/zoom-in amounts.

If it is determined that the value of X1 and the value of X2 are same(X1=X2), the CPU 146 calculates the pan/tilt amounts in step S5523. Instep S5523, the CPU 146 performs the pan/tilt operations in accordancewith the calculated pan/tilt amounts.

If it is determined that the value of X1 is larger than the value of X2(X1>X2) in step S5020, the CPU 146 calculates the pan/tilt/zoom-outamounts in step S5525. In step S5526, the CPU 146 performs thepan/tilt/zoom-out operations in accordance with the calculatedpan/tilt/zoom-out amounts.

Note that the client 200 can use the GetConfigurationOptions command1203 to inquire, of the image capturing apparatus 100, about capabilityinformation indicating whether the SetBoxZoom command is executable.Therefore, the client 200 can transmit the GetConfigurationOptionscommand 1203 serving as an inquiry command to an image capturingapparatus that has never been connected to the client 200 in the past.Based on a response from this image capturing apparatus, even if thecommunication destination image capturing apparatus is an imagecapturing apparatus that has not been connected to the client 200 in thepast, the operation of this image capturing apparatus can be controlledby issuing a SetBoxZoom command.

As described above, according to the embodiment, the image capturingrange of the captured image can be easily and appropriately adjusted.For example, user operation can be assisted and supported so that theuser can appropriately designate a zoom region on the captured image.

According to the present invention, the image capturing range of thecaptured image can be easily and appropriately adjusted.

Other Embodiments

Embodiment(s) of the present invention can also be realized by acomputer of a system or apparatus that reads out and executes computerexecutable instructions (e.g., one or more programs) recorded on astorage medium (which may also be referred to more fully as a‘non-transitory computer-readable storage medium’) to perform thefunctions of one or more of the above-described embodiment(s) and/orthat includes one or more circuits (e.g., application specificintegrated circuit (ASIC)) for performing the functions of one or moreof the above-described embodiment(s), and by a method performed by thecomputer of the system or apparatus by, for example, reading out andexecuting the computer executable instructions from the storage mediumto perform the functions of one or more of the above-describedembodiment(s) and/or controlling the one or more circuits to perform thefunctions of one or more of the above-described embodiment(s). Thecomputer may comprise one or more processors (e.g., central processingunit (CPU), micro processing unit (MPU)) and may include a network ofseparate computers or separate processors to read out and execute thecomputer executable instructions. The computer executable instructionsmay be provided to the computer, for example, from a network or thestorage medium. The storage medium may include, for example, one or moreof a hard disk, a random-access memory (RAM), a read only memory (ROM),a storage of distributed computing systems, an optical disk (such as acompact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)™),a flash memory device, a memory card, and the like.

While the present invention has been described with reference toexemplary embodiments, it is to be understood that the invention is notlimited to the disclosed exemplary embodiments. The scope of thefollowing claims is to be accorded the broadest interpretation so as toencompass all such modifications and equivalent structures andfunctions.

What is claimed is:
 1. A control apparatus that obtains a captured imagefrom an image capturing apparatus and controls a display of the capturedimage on a display screen of a display unit, comprising: one or moreprocessors; and a memory storing instructions that, when executed by theone or more processors, cause the image capturing apparatus to:determine a region defined by a pair of first coordinate values and apair of second coordinate values at least one of which is designated onthe captured image displayed on the display screen; control the displayunit to shift a display of the captured image, when the region exceeds adisplay range of the captured image in accordance with an operation ofdesignating at least one of the pair of first coordinate values and thepair of second coordinate values, by a portion that has exceeded therange; and output a command to control at least one of pan, tilt, andzoom for obtaining a captured image corresponding to the determinedregion.
 2. The apparatus according to claim 1, wherein the command isdetermined based on a magnitude relation between the pair of firstcoordinate values and the pair of second coordinate values defining theregion.
 3. The apparatus according to claim 1, wherein the command isfor capturing an image of which a center corresponds to a center of thedetermined region.
 4. The apparatus according to claim 1, wherein theinstructions, when executed by the one or more processors, further causethe image capturing apparatus to control the display of the determinedregion so that the determined region does not exceed the maximum angleof view of the image capturing apparatus.
 5. The apparatus according toclaim 1, wherein the pair of first coordinate values and the pair ofsecond coordinate values each are coordinate values of a two-dimensionalcoordinate system for displaying the captured image on the display unit,the pair of first coordinate values are coordinate values defining astart point of a range of the region, the pair of second coordinatevalues are coordinate values defining an end point of the range of theregion, and wherein the instructions, when executed by the one or moreprocessors, further cause the image capturing apparatus to determinewhether the region exceeds the range of the captured image based onwhether the pair of second coordinate values exceed the range of thecaptured image.
 6. The apparatus according to claim 1, wherein theinstructions, when executed by the one or more processors, further causethe image capturing apparatus to control the display unit to display apredetermined image by the portion that has exceeded the range.
 7. Acontrol method for obtaining a captured image from an image capturingapparatus and controlling a display of the obtained image on a displayunit, comprising: determining a region defined by a pair of firstcoordinate values and a pair of second coordinate values at least one ofwhich is designated on a captured image displayed on the display screen;controlling a display unit to shift a display of the captured image,when the region exceeds a display range of the captured image inaccordance with an operation of designating at least one of the pair offirst coordinate values and the pair of second coordinate values, by aportion that has exceeded the range; and outputting a command to controlat least one of pan, tilt, and zoom for obtaining a captured imagecorresponding to the determined region.
 8. The method according to claim7, wherein the command is determined based on a magnitude relationbetween the pair of first coordinate values and the pair of secondcoordinate values defining the region.
 9. The method according to claim7, wherein the command is for capturing an image of which a centercorresponds to a center of the determined region.
 10. The methodaccording to claim 7, further comprising controlling the display of thedetermined region-so that the determined region does not exceed themaximum angle of view of the image capturing apparatus.
 11. Anon-transitory computer-readable storage medium storing a computerprogram for causing a computer to execute a control method for obtaininga captured image from an image capturing apparatus and controllingdisplay of the obtained image on a display unit, comprising: determininga region defined by a pair of first coordinate values and a pair ofsecond coordinate values at least one of which is designated on acaptured image displayed on the display screen; controlling a displayunit to shift a display of the captured image, when the region exceeds adisplay range of the captured image in accordance with an operation ofdesignating at least one of the pair of first coordinate values and thepair of second coordinate values, by a portion that has exceeded therange; and outputting a command to control at least one of pan, tilt,and zoom for obtaining a captured image corresponding to the determinedregion.
 12. The non-transitory computer-readable storage mediumaccording to claim 11, wherein the command is determined based on amagnitude relation between the pair of first coordinate values and thepair of second coordinate values defining the region.
 13. Thenon-transitory computer-readable storage medium according to claim 11,wherein the command is for capturing an image of which a centercorresponds to a center of the determined region.
 14. The non-transitorycomputer-readable storage medium according to claim 11, furthercomprising controlling the display of the determined region-so that thedetermined region does not exceed the maximum angle of view of the imagecapturing apparatus.